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REVERSIBLE WATERMARKING OF DIGITAL SIGNALS 

TECHNICAL nELI> 

5 The present invention generally relates to the field of providing additional infbrmatlon In 
media content, which has been niapped for allowing insertion of additional information. 
The invention is more particularly related to providing reversible watermarking in signals 
comprising media content. 

10 DESCRIPTION OF RELATED ART 

It is known to provide additional information in relation to media contmt. One such 
instance is within the field of watermarking, where Information is embedded in a media 
file, like for instance in a digital image. The watermark can then be retrieved from the 

15 image and used for different purposes. It Is furthermore also known with reversible 
watermarking in the field of images, where the original image can be restored after 
removal of the watermark. A principal advantage of these schemes is that the bandwidth 
of the communication channel (i.e. the media file) does not need to be increased. I.e. It is 
an in-band information channel. One such tedinique is described by J. Fridrich, M. Goijan, 

20 and R. Du in ""Ijossless data embedding for all Image formats", Proc. SPIE Photonics West, 
Vol. 4675, Security and Watermarking of l^luitimedia Contents, San Jose, California, 
Januar/ 2002, pp. 572 - 583. 

There is however a need for an alternative technk|ue where additional information, 
25 perhaps in the fbrm of watermarks, can be added to media content in a way, that allows 
the avokiing of loss of information in the original media content and that can also be used 
for audk) while allowing a higher data capacity for the additional information. 

SUMMARY OF THE INVENTION 

30 

It is thus an object of the present invention to provide additional Information In a signal 
having media content, which allows the avoiding of loss of Information in the original 
media content and can be used for audio while allowing a high data capacity for the 
additional information. 

35 

According to a first aspect of the present invenijon, this object is achieved by a method of 
sending additional information In a signal having media content comprising the steps of: 

mapping the amplitude values of the media content onto first new values using a 

first mapping function, and 
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inserting the additional infontiation Into the mapped media content . 

According to a second aspect of the present Invention, this obrject Is also achieved by a 
method of receiving additional information In a signal having media content, comprising 
5 the steps of: 

receiving a signal Including media content the amplitude values of which have been 
mapped onto first new values using a first mapping funcUon together with 
embedded additional Information, and 
removing the additional information from the media content. 

According to a third aspect of the present invention, this object Is furthermore achieved by 
a device providing additional Infomiatlon In a signal having media content, comprising: 
a first mapping unit arranged to map the amplitude values of the media 
content onto first new values using a first mapping function, and 
a multiplexing unit for Inserting the additional information into the mapped 
media content. 

According to a fourth aspect of the present invention, this object Is also achieved by a 
device for receiving additional Information In a signal having media content, comprising: 
a demultiplexing unit arranged to: 

receive a signal Including media content the amplitude values of which have 
been mapped onto first new values using a first mapping foncUon together 
with additional information, and 

remove the additional information from the media content. 

According to a fifth aspect of the present Invention, this object is also achieved by a 
system of devices that can communicate with each other comprising: 

a device providing additional information In a signal having media content, 
comprising: 

a first mapping unit arranged to map the amplitude values of the 
media content onto first new values using a first mapping function, 
and 

a multiplexing unit for inserting the additional information into the 
mapped media content, and 
a device for receiving additional information in a signal having media 
content, comprising: 

a demultiplexing unit arranged to receive a signal including media 
content the amplitude values of which have been mapped onto first 
new values using said first mapping function together with 
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embedded additional Information, and remove the additional 
Information from tlie media cx>ntent. 

According to a sixtli aspect of the present invention, this object is also achieved by a signal 
5 comprising media content with embedded additional Information, where the amplitude 
values of the media content have been mapped onto new values using a first mapping 
ftinction, such that the additional information can be retrieved from the mapped media 
content 

10 Claims 2 and 18 are directed towards providing at least one hole in the amplitude levels of 
the mapped media content, which is used for inserting additional Information. 

Claims 3 and 19 are directed towards using a hole and a corresponding value of the 
mapped media content for inserting additional Information In the media content. 

15 

Claims 4, 15, 20 and 26 are directed towards using an error signal for allowing restoration 
of the original media content essentially without losses. 

Claims 7 and 16 are directed towards providing information enabling selection of a second 
20 mapping function for restoration of original media content. 

Claims 9 and 22 are directed towards providing at least two different first mapping 
functions to be used for the media content. 

25 Claim 10 Is directed towards selecting first mapping function based on the properties of the 
media content. 

Claims 11 and 23 are directed towards providing at least two different second mapping 
funcdons for mapping media content for which the amplitude values have been mapped 
30 onto first new values using at least two first mapping functions. 

The present invention has the advantage of providing a way to embed additional 
information, like watermarks, in media content that allows restoring of the original media 
content after removing the embedded information, that has a large possible data capacity 
35 for the additional information. Is well suited for audio applications, and where the 
additional Information Is hardly perceptible in the media content . 
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The general idea behind the invention Is thus to provide additional information. In media 
content, like an audio signal, of which the amplitude values have been mapped on new 
values. 

5 These and other aspects of the invention will be apparent from and elucidated with 
reference to the embodiments described hereinafter. 

BRIEF DESCRIPTION OF THE DRAWINGS 

10 The present Invention will now be explained in more detail in relation to the enclosed 
drawings, where 

fig 1 shows a block schematic of an encoder and a decoder according to a first 
embodiment of the inv^tlon, 
15 fig. 2 shows charts showing exemplifying first and second mapping functions as well as 
error signals generated by an encoder according to the invention, 
fig. 3 shows a flow chart: of a method of embedding an audio signal with a watermaric 
according to the invention, 

fig. 4 shows a flow chart of a method of extracting a watermaric ftom an audio signal 
20 according to the invention, 

fig. 5 shows a block schematic of an encoder and a decoder accortling to a special variation 
of the first embodiment of the invention, 

fig. 6 shows charts showing two other exemplifying first and second mapping functions 
generated by an encoder according to the Invention suitable for use In the encoder and 
25 decoder In fig. 5, 

fig. 7 shows the general form of a signal according to the invention as used in the second 
embodiment, 

fig. 8 shows a block schematic of an encoder according to a second embodiment of the 
present invention, 

30 fig. 9 shows a block schematic of an encoder according to a third embodiment of the 
. present invention, and 
fig. 10 shows a block schematic of an encoder according to a fourth embodiment of the 
present Invention. 

35 DETAILED DESCRIPTION OF EMBODIMENTS 

The present Invention relates to the field of providing additional Information In relation to a 
signal comprising media content. One preferred area of use is the area of reversible 
watermaricing of audio streams. The Invention is however not limited to this area, but can 
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be used In many other different fields of technology and for other types of signals like for 
instance digital Images. 

Rg. 1 schematically shows an encoder 10, which is communicating with a. decoder 12 via 

5 an Interface. The Interface Is Indicated with a dashed vertical line. The Interface can be 
such a thing as the Internet or an Intranet, but need not be such a network. It can for 
instance also be a telephone network, either fixed or wireless. The encoder 10 inserts a 
watermark D Into a digital data stream, which in this example Is an audio stream x. The 
actual functioning of the encoder will be described shortly. The encoder 10 Includes a first 

10 mapping unit 14, which receives media content in the form of PCM samples of audio x on 
its input. The encoder uses a first mapping function Cq of a first type, which can be a 
compressing function, although the invention Is not limited to compressing functions. The 
output of the first mapping unit 14 Is connected to the Input of a second mapping unit 18 . 
using a second mapping function Eq of a second type, which can be an expanding function, 

15 although the Invention is not limited to expanding functions. The output of the first 

mapping unit 14 is also connected to a first input of a multiplexing unit 16. The output of 
the second mapping unit 18 Is connected to a subtracting unit 19, which subtracting unit 
also receives the Input samples of the original audio signal x. The subtracting unit 19 is 
furthermore connected to the input of an error compressing unit 20 applying error signal 

20 compression L. The output of the error compressing unit 20 is connected to a second input 
of the multiplexing unit 16. The multiplexing unit also has a third Input receiving overhead 
data O and a fourth input receiving a watermark or additional data D, The multiplexing unit 
16 also has an output on which an output signal y including audio, where amplitude values 
have been mapped onto new values and is provided together with a watermark. 

25 

As mentioned above, fig. 1 also Includes a decoder 12. The decoder Includes a 
demultiplexing unit 22, having an Input on which It receives the signal y. The 
demultiplexing unit has a first output connected to a third mapping unit 24 applying a 
second mapping function Eq. The demultiplexing unit has a second output connected to an 

30 error expanding unit 26 applying an error expanding function L"^, which is the inverse of 
the previously mentioned error compressing function L. The demultiplexing unit 22 has a 
third output on which the watermark D is provided and a fourth output on which overhead 
data O is provided. The output of the thirxl mapping unit 24 is connected to an adding unit 
27, to which adding unit also the output of the error expanding unit 26 Is connected. From 

35 this adding unit a restored original signal x Is provided. 

Fig. 2 shows three charts, where a first outlines the mapping of Input signal samples x(n) 
onto output signal samples XQ(n) In the form of first new values according to a first 
mapping function Cqi, a second outlines the mapping of Input signal samples XqCn) in the 
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form of first new values onto output samples x(n) in the form of second new values 
according to a second mapping fiincUon Eqi and a third outlines an error signal q(n) 
depending on the Input signal x(n). 

5 Embedding or Insertion of a watermark Into media content in the form of an audio signal or 
audio stream according to a first embodiment of the invention will now be explained with 
reference being made to fig. 1, 2 and 3, where fig. 3 shows a flow chart of a method 
according to the invention. First digital PCM (Pulse Code r4odulatlon) samples of an audio 
signal are received in the encoder 10. These could be received from any type of application 

0 like an audio playing device, for instance a CD-player or from a telephone application. 
They could also be retrieved from a store where for Instance audio files are stored. The 
amplitude of the dIfPereht samples x are then mapped onto new values using a first 
mapping function Cq for obtaining a signal Xq comprising the samples, step 28- In this first 
embodiment a first mapping function Cqi will be used. 

5 • 

In the left upper part of fig. 2 is shown a chart showing this first mapping function Qji 
according to the invention. The mapping function maps Input samples of an Input signal 
onto output samples. According to this spedflc scheme Input amplitudes of 16 levels are 
mapped onto output amplitudes of 8 levels. An input amplitude level zerx> is mapped onto 
0 an output level zero, an input amplitude level one is mapped onto an output amplitude 
level two, an input amplitude level two is mapped onto an output amplitude level four. So 
far there has been a one to one correspondence between the original samples and the 
mapped samples. An Input amplitude level three Is mapped onto an output amplitude level 
six while an input amplitude level four Is also mapped onto the output amplitude level sbc. 
An input amplitude level five Is mapped onto an output amplitude level eight, while an 
Input amplitude level six is mapped onto an output amplitude level ten. Also Input 
amplitude levels seven and eight are mapped onto the output amplitude level ten. Input 
amplitude levels 9, 10 and 11 are mapped onto an output amplitude level twelve and Input 
amplitude levels 12, 13, 14 and 15 are mapped onto an output amplitude level fourteen. 
The output signal Xq having been mapped witti the first mapping function thus only has 
eight different possible amplitude levels or values and where every odd level is not used. 
Every odd level therefore constitutes a hole in the mapped media content. This means that 
the odd levels can be used for additional Information. Since some Input levels share the 
same output level there Is furthermore no one to one correspondence between Input 
amplitude level and output amplitude level 

The first mapped signal Xq Is then mapped again in the second mapping unit 18 using a 
second mapping function EQfor obtaining a second new values xe of the media content, 
step 30. 
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The second mapping is in this first embodiment perfomied using a second mapping 
function Eqi shown using the exemplifying chart In the upper right part of fig. 2. An Input 
level zero is here mapped onto an output level zero^ an Input level two.Is mapped onto an 

5 output level one, an Input level four Is mapped onto an output level two, an input level six 
is mapped onto an output level three, an input level eight is mapped onto an output level 
five, an Input level ten is mapped onto an output level six, an Input level twelve is mapped 
onto an output level nine and an input level fourteen is mapped onto an output level 
twelve. As can be seen here all the levels of the Input signal x are not present In the 

10 second new signal xe. 

If a simple second mapping of the first mapped signal xq were to be used alone, that would 
mean that some Information might be lost when using this second mapping function. The 
second mapped signal xe Is therefore supplied to a subtracting unit 19, which unit 19 also 

15 receives the original signal x. The subb^cting unit subtracts the second mapped signal Xe 
from the original signal x for obtaining a companding error signal q, step 32. The 
correspondence between the error signal q(n) and the different amplitude levels of the 
original Input signal x(n) is shown In the lower part of fig. 2. Because of the one-to one 
correspondence between the original levels zero - three and the first mapped levels, the 

20 error signal q Is zero for these levels, while it is one for level four and zero again for the 
levels five and six. The error signal Is one for level seven and two for level eight. The error 
is furthermore zero for level nine, one for level ten and two for level eleven. Finally the 
error q(n) is zero for level twelve, one for level thirteen, two for level fourteen and three 
for level fifteen. The error signal q Is then supplied to the error compressing unit 20 

25 applying a compressing function L onto the error signal for obtaining a compressed error 
signal qt, step 34. This compressed error signal Is submitted to the multiplexing unit 16 
along with the Input signal Xq mapped according to the first mapping function, overhead 
data D and additional information or data In the form of a watermark D. 

30 The multiplexing unit 16 then Inserts or embeds the, possibly compressed, companding 
error signal qu some overhead information O and the watemnaric D into the positions made 
free by the first mapping function xq of the original signal x. I.e. In the odd samples of the 
mapped signal xq, for obtaining the transmit signal y, step 36, and transmits the signal y 
to the decoder 12, step 38. To explain the method of adding the additional data it is 

35 convenient to look at the process from a histogram perspective. After applying the first 
mapping function, the original signal with corresponding histogram is transformed In a 
different one with corresponding mapped histogram. The mapped histogram will have 
sample values with zero entries. I.e. these particular samples do not occur in the 
transformed signal. For the remainder we define these positions as holes. The additional 
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information was added by using a Gombination of hole and anottier new mapped vaiue 
corresponding to the hole. This means that for a given sample of the media content an 
additional piece of information In the form of a "'one" is added by changing the mapped 
even level to a corresponding uneven or odd level and a zero is added by Iceeping the 
5 mapped level unchanged. In this first embodiment each even level will have a 

corresponding hole and therefore a bit of additional information can be added to each 
sample. By a mapped level and a corresponding hole is meant that for Instance that level 
zero of the signal Xq would correspond to the hole at level one. Every time a mapped 
sample having level zero Is arriving at the multiplexing unit 16, this unit will change the 

10 level of the sample to level 1 when Inserting a "'one" and keep It unchanged when Inserting 
a ''zero" of additional information. The overhead O may include Information that is used for 
allowing decoding Or Information that makes the decoding efficient. The overhead may 
furthermore Include information such as frame size and synchronisation words if the input 
signal is divided into frames. It can also Include CRC or error correcting information or a 

15 pointer that Indicates position of different data portions in the embedded bitstream. 

Now the processing In the decoder will be described with reference made to fig. 1, 2 and 4, 
where fig. 4 shows a flow chart of a method of decoding a signal according to the 
invention. The decoder 12 receives the signal y sent from the encoder 10 on an input of 
20 the demultiplexing unit 22, step 40. The demultiplexing unit 22 extracts the embedded 
overhead information O, the watermark D and the, possibly compressed, companding error 
signal Ql for obtaining the audio signal Xq mapped according to the first mapping function 
without the added information, step 42. The first mapped amplitude levels, which have 
received a ''one'' -bit of additional information and are thus odd, . then receive their 
25 corresponding even amplitude level after the additional Information has been extracted. 
The overhead O and the watermark D are then processed in a suitable manner. The audio 
signal Xq mapped according to the first mapping function is submitted to a third mapping 
unit 24, which uses a second mapping function Eq, and in this example the same second 
mapping function Eqi as the second mapping unit 20 in the encoder 10 used for providing 
a signal Xe mapped according to the second mapping function, step 44. The compressed 
error signal qt is at the same time provided to the error expanding unit 26 which applies 
an expanding fonction L'^ to the compressed error signal Ql for obtaining the original error 
signal q, step 46. The expanding function is the Inverse of the compressing function used 
on the encoder side. The retrieved error signal q is then supplied to the adding unit 27 
together with the signal Xg mapped according to the second mapping function, where these 
two signals are added to each other for providing the original audio signal x, step 48. In 
this way a watermark has been added to an audio signal, which has been mapped 
according to the first mapping function, and both the watermark and the original audio 
signal have been restored, and the audio signal Is retrieved without losses. 
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There are a number of variations that can be made, of which one variation according to a 
variation of the first embodiment of the Invention is shown in a biodc schematic in fig. 5. 
The only difference between this variation and the first described embodiment is that a 
5 first shifting unit 50 has been provided between the first mapping unit 14 and the 
multiplexing unit 16 and that a second shifting unit 52 has been provided between the 
demultiplexing unit 22 and the third mapping unit 24, Another difference is also that other 
first and second mapping functions are used. The first mapping function Cq2 used in the 
first mapping unit 14 is here a compressing function, while the second mapping function 
10 Eq2 used in the second and third mapping units 18 and 24 Is here an expanding function, , 
which functions are shown In the charts in fig. 6. This first mapping function maps an 
amplitude level zero onto a compressed level zero, an Input amplitude level one is mapped 
onto an output amplitude level one, an Input amplitude level two is mapped onto an output 
amplitude level two. An Input amplitude level three Is mapped onto an output amplitude 
15 level three while an input amplitude level four is also mapped onto the output amplitude 
level three. An input amplitude level five is mapped onto an output amplitude level tour, 
while an Input amplitude level six is mapped onto an output amplitude level 5. Also Input 
amplitude levels seven and eight are mapped onto the output amplitude level six. Input 
amplitude levels nine, ten and eleven are mapped onto an output amplitude level six and 
20 input amplitude levels twelve, thirteen, fourteen and fifteen are mapped onto an output 
amplitude level seven. The first mapped output signal Xq thus only has eight diflPerent 
possible low-level amplitude levels, while the high-level levels are not used. The second 
mapping function maps the Input level zero onto an output level zero. The input level one 
Is mapped onto an output level one, an Input level two Is mapped onto an output level two, 
25 an Input level three Is mapped onto an output level three, an input level four Is mapped 
onto an output level five, an Input level five Is mapped onto an output level six, an Input 
level six is mapped onto an output level nine and an input level seven is mapped onto an 
output level twelve. The first shifting unit 50 acts to shift the compressed audio signal xq p 
positions to the left, where p is one In the present case, i.e. multiplies the compressed 
30 signal samples with a factor of 2^. In the same manner the second shifting unit 52 acts to 
shift the received input signal (after overhead, watermark and error signal have been 
removed) p positions to the right. I.e. performs a multiplication of 2'^, which restores the 
compressed signal xq- In this system the audio signal is compressed such that the upper 
levels of the audio Is left unused. The compressed signal Is then shifted such that the least 
35 significant bits can be used for watermaric, overhead and error signal. This greatly 
simplifies the insertion and extraction of this additional information. A signal y of a 
compressed sample according to this variation Is outlined In fig- 7, showing a four-bit 
signal or sample where «ie first three most significant bits are shown including the 
compressed sample XQ(n) followed by one bit of watermaric data D and/or error signal q 
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and/or overhead O. All the added Information is thus provided in the least significant bit of 
this signal y. 

There are some variations of this basic part of the invenHon that are best mentioned here. 
5 Rrst of all it has to be mentioned that if the first mapping function used has a one-to-one 
correspondence in the mapping of levels, there is no need for an error signal. In this 
special case and error signal and the processing associated with It Is not necessary to 
include in the device. When this pre-requlsite exists there Is ftjithermore no need for the 
second mapping unit, the subtracting unit and the error compressing unit In the encoder 

10 and no adding unit and error expanding unit in the decoder. What Is important then Is 
however that the third mapping unit In the decoder uses a mapping function, which is the 
Inverse of the first mapjjing function In the encoder. Such a situation might be present for 
audio or other types of media content, which do not have amplitude values in the upper 
half of the amplitude specbxim. Another possible variation In case an errx)r signal Is used, 

15 Is that the second mapping function used does not have to be the inverse of the first 
mapping foncUon. Another second mapping fonctlon can be used. In this case the 
difference would most certainly lead to larger error signals. The information In the error 
signal would also lead to a restoration of the original signal on the decoder side. The error 
signal can furthermore be left uncompressed, but this might lead to a reduction of the 

20 capacity for the embedded data channel. There does furthermore not have to be any 
overhead information provided in the transmitted signal y. The first mapped output signal 
does not have to provide a hole at even levels, but can just as well provide them at odd 
levels. It does furthermore not need to provide holes at all the even levels. In one 
variation It only provides one hole In the amplitude levels, where the original value Is 

25 mapped onto another value, which does not have to be a value, which Is a neighbouring 
value, even though this Is preferred. In the same way the corresponding value to the hole 
used when inserting the additional bit of information does not have to be the next higher 
value, but it can also be a lower value or almost any other possible value of the mapped 
media content. It can be an advantage if this corresponding value Is a value that Is 

30 frequent in the mapped media content. 

Some fortJier aspects of the invention will In the following be described in relation to fig. 8 
- 10. 

35 A second embodiment of the Invention will now be described In relation to fig. 8, which 
shows an encoder 12, which is basically the same encoder as was shown In flg. 1. The 
differences in relation to the first embodiment are that a fourth mapping unit 54 is 
provided in parallel with the first previously described mapping unit 14. The first mapping 
unit 14 uses a first mapping fonctlon Cqa, while the fourth mapping unit 54 uses another 



PHNL030078EPP 



H 17.01.2003 

first mapping function Cqb- Before this pair of mapping units 14 and 54 there is also 
provided a segmentation unit 56. A first switch 58 is provided between the segmentation 
unit 56 and the pair of mapping units 14 and 54 and a second switch 59 is provided 
between the pair of mapping units and the multipiexing unit 16 and the second mapping 

5 unit 18. The switches are switched in synchronism for connecting either of the first or 
fburth mapping units 14 and 54 to the second mapping unit 18 and the multipiexing unit 
16. The first and fourth mapping units 14 and 54 here have two different functions which 
give different mapping results, where one might be provided for providing the highest 
possible capacity regarding how much additional data needs to be inserted, while the other 

10 might be better for minimizing perceptual distortion In the output signal y. Note that 
because of this the first mapping functions described in fig. 2 and 6 might not be suitable 
for these mappings, which is indicated by denoting the functions Cqa and Cqb instead of Cqi 
and Cq2. An input signal is furthermore segmented before It Is provided to a mapping unit. 
Note that the encoder here uses the same second mapping function all the time. In this 

15 second embodiment It might be possible for a user to select different first mapping 

functions. Difi^rences In the signal mapped by the third mapping unit because of different 
first mapping functions are taken care of by the error signal generated. The decoder is 
essentially the same in this second embodiment as the decoder shown in the first 
embodiment in that it does not include any extra functionality. The second mapping 

20 function used will most probably differ from the first embodiment, though. It is here 

preferable that the decoder uses the same second mapping function that the encoder uses. 
If small errors are allowed slight variations of the functions can be allowed for retrieving 
the original signal. 

25 An encoder according to a third embodiment of the invention is shown in a biocic 
schematic In fig. 9. There Is mainly one dIfFerence between the third and the second 
embodiments, and that is that a fifth mapping unit 60 is provided In parallel with the 
second mapping unit 18. A third switch 62 is connecting the input of the multiplexing unit 
16 with either of the second or fifth mapping units 18 and 60 and a fourth switch 64 Is 

30 connecting either of the second or fifth mapping units 18 and 60 to the subtracting unit 19. 
The thirxJ and fourth switches are to be switched In synchronism with the first and second 
switches 58 and 59. The second mapping unit 18 provides a second mapping function Eqa 
which is to be used together with the first mapping function Cqa, while the fifth mapping 
unit 60 provides another second mapping function Eqb which Is to be used together with 

35 the first mapping function Cqb. With this embodiment the second mapping functions are 
switched such that a second mapping function suitable for a selected first mapping function 
can be used. Here the selection of first and second mapping functions can for instance be 
made based on a random (possibly secret) Icey. This is advantageous since It reduces the 
error signals generated and therefore the watermark can be made to occupy more space In 
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the transmitted signal. It Is here necessary that the decoder also is provided with the same 
number of parallel second mapping functions for being able to switch between different 
mapping units in order to function properly. In order for the decoder to be able to perform 
this switching, information about the selection of second mapping ftinction has to be 
5 transmitted from the encoder. It Is also possible to transmit Information about selected 
first mapping function Instead, in which case the decoder can select second mapping 
function based on this Information. It is also possible to send Information about both the 
first and second mapping functions used in the encoder. This information can be provided 
in the overhead. The properties can as an altematlve be determined from properties of the 
10 Input signal y. The decoder does furthermore not have to use the same type of second 
mapping function as the encoder does, as long as the final scheme is reversible. 

An encoder according to a fourth embodiment of the invention is shown in a blocic 
schematic in fig. 10. The difference from the third embodiment is that a signal property 

15 extracting unit 66 is provided which analyses the input signal and controls the switches in 
order to select first mapping function and second mapping function in dependence on the 
properties of the signal. In this way an adaptive mapping scheme is provided that can 
select mapping function in dependence of the Input signal or the different segments of the 
input signal. In case the signal Is a video signal, different mapping functions can be used 

20 for different frames of the signal. The signal property extracting unit could also be 
combined with the second embodiment as well, i.e. without the fifth mapping unit 

It should be realised that the decoder need not be performing the full decoding described 
above. In dependence of If the original signal need to be restore or not it might be 
25 sufficient to only remove the watermark and not restore the original signal at all. The 
restoration might furthermore be made incompletely so that a few errors are allowed, 
where the final restored signal might be estimated. The media content does furthermore 
not have to be provided in the form of audio, but the invention can be used on any type of 
media content including images and video. It is furthermore possible to select between 
more than two first and/or second mapping functions. The second mapping function in the 
decoder can furthermore be selected in response to the output signal x as an altematlve to 
the properties of the signal y and the overhead information. The error signal need 
furthermore not be included In the signal y, but can be provided to the decoder In some 
other way, for instance In another signal, perhaps provided before sending the signal y. 
Yet another variation of the invention is that the encoder need not be sending the signal y 
to the decoder. It Is also possible that the encoder stores this signal In a memory, which 
can be a portable memory lilce a CD ROM, from which the decoder could retrieve the 
signal. In this case the decoder would receive the signal from the memory Instead of from 
the encoder. 
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The present invention lias many advantages. It allows a higher degree of coding in a 
media stream, i.e. has a large possible data capacity for the additional information 
including the watermarlc It also allows for flexible coding as well as avoids loss of 
5 information in the original media content. 
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CLAIMS 

1. Method Of sending additional fnfonmation In a signal (y) having media content 
comprising the steps of: 
5 mapping the amplitude values of the media content (x) onto first new values using 

a first mapping ftjncOon {C^, (step 28), and 

inserting the additional information (O, D) Into the mapped media content (xq), 
(step 36). 

10 2. Method according to claim 1, wherein the first mapping function creates at least 
one hole in the amplitude values of the mapped media content to be used fbr 
embedding additional Information. - - 

3. Method according to claim 2, wherein the step of inserting additional Information 
15 comprises using said at least one hole and a corresponding value of the mapped 

media content for embedding additional data. 

4. Method according to claim 1, wherein the step of mapping includes allowing the use 
of one first new value of the media content to correspond to more than one 

20 unmapped value of the original media content and further comprising the steps of: 

mapping the first new values of the media content (Xq) onto second new values 
using a second mapping function (Eq), (step 30), and 

generating an emor signal (q) comprising the difference between the second new 
values of the media content (xe) and the original media content (x), (step 32), and 
25 sending the error signal (q) to the receiver. 

5. Method according to dalm 4, further Including the step of compressing the error 
signal (step 34). 

30 6. Method according to claim 4, furtrher comprising the step of sending the media 

content (xq) that has been mapped using the first mapping function together with 
the additional information (O, D) to a receiver (12), (step 38), wherein the error 
signal is Included in the media content sent to the receiver. 

35 7. Method according to dalm 4, ftirther comprising the steps of sending the media 
content (xq) that has been mapped using the first mapping flincHon together with 
the additional information (O, D) to a receiver (12), (step 38), and sending 
Information about first and/or second mapping function used to the receiver. 
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8. Method according to claim 1, wherein the Information about second mapping 
ainctlon used Is Included in the media content sent to the receiver. 

9. Method according to claim 1, further Including the step of selecting a first mapping 
5 funcUon among at least two first mapping functions and performing the step of 

mapping using the selected function for at least a part of the media content. 

10. Method according to claim 9, wherein the step of selecting Is performed In 
dependence of properties of the media content. 

10 

11. Method according to claim 9, further including the steps of: 

selecting a second mapping function among at least two second mapping functions, 
mapping the first new values of the amplitude of the media content using the 
second mapping function onto second new values for parts of the media content 
15 mapped according to the selected first mapping function, and 

generating an error signal comprising the difference between the second mapped 
media content and the original media content for the selected first and second 
mapping functions,. 

20 12. Method of receiving additional Information In a signal having media content, 
comprising the steps of: 

receiving a signal (y) Including media content (xq) the amplitude values of which 
have been mapped onto first new values using a first mapping function (Cq) 
together with embedded additional information (O, D), (step 40), and 
25 removing the additional information (0,D) from the media content, (step 42). 

13. Method according to claim 12, further including the step of processing the 
additional information. 

30 14. Method according to claim 12, further including the step of mapping the amplitude 
of the received first new values of the media content onto second new values using 
a second mapping function (Eq), (step 44). 

15. Method according to daim 14, further including the steps of receiving an error 
35 signal (q) corresponding to an error between the original media content (x) and 

media content (xe) mapped with the second mapping function (Eq) and adjusting 
the media content mapped using the second mapping function (Eq) with the error 
signal, (step 48). 



16 
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16. Method according to claim 14, further Including the step of receiving first or second 
mapping function infbrmatlon and applying a second mapping function acconJing to 
this Information on at least parts of the received media content. 

17. Device (10) providing additional Information in a signal having media content, 
comprising: 

a first mapping unit (14) arranged to map the amplitude values of the 
media content (x) onto first new values using a first mapping function (Cq), 
and 

a multiplexing unit (16) for inserting the additional Information (O, D) into 
the mapped media content. 

18- Device according to claim 17, wherein the first mapping unit is arranged to create 
at least one hole in the amplitude values of the mapped media content to be used 
for embedding additional information. 

19- Device according to claim 18, wherein the multiplexing unit Is arranged to use said 
at least one hole and a corresponding value of the mapped media content for 
embedding additional data. 

20- Device according to claim 17, further comprising a second mapping unit (18) 
arranged to map the first new values of the media content (xq) onto second new 
values using a second mapping function (Eq) and a subtracting unit (19) arranged 
to subtract the original media (x) content finom the second new values of the media 
content (xe) for providing an error signal (q). 

21- Device according to claim 20, wherein the multiplexing unit (16) is arranged to 
insert the error signal In the first new values of the media content. 

22. Device according to claim 17, wherein there are at least two mapping units (14, 
54) performing two diff'erent first mapping functions and furthemiore comprising a 
first switch (58) arranged to connect the original media content to either one of the 
first mapping units. 

23. Device according to dalm 22, further comprising at least two mapping units (18, 
60) performing two different second mapping functions and each arranged to map 
first new values of the media content (xq) onto second new values, a subtracting 
unit (19) arranged to subtract original media content (x) from second new values 
of the media content (x^) for providing an error signal (q), a ftirther switch (62) 
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arranged to connect the first new values of the media content to either one of the 
mapping units performing a second mapping function and yet a further switch (64) 
arranged to connect either one of the mapping units performing a second mapping 
function to the subtracting unit. 

5 

24. Device (12) for receiving additional information (O, D) in a signal (y) having media 
content, comprising: 

a demultiplexing unit (22) arranged to: 

receive a signal (y) Including media content the amplitude values (x) of 
10 which have been mapped onto first new values (xq) using a first mapping 

function (Cq) together with embedded additional information (O, D), and 
remove the additional information from the media content. 

25. Device according to claim 24, further comprising: 

15 an third mapping unit (24) arranged to map the the first new values of the received 

media content to second new values using a second mapping function (Eq). 

26. Device according to claim 25, further comprising an adding unit (27) arranged to 
add a received error signal (q) to the second new values of the media content (xg) 

20 for providing at least essentially lossless media content. 

27. System of devices that can communicate with each other comprising: 

a device (10) providing additional information (O, D) in a signal (y) having 
media content, comprising: 
25 a first mapping unit (14) arranged to map the amplitude values of 

the media content onto first new values using a first mapping 
function (Cq), and 

a multiplexing unit (16) for Inserting the additional Information into 
the mapped media content, and 

30 a device (12) for receiving additional information (O, D) in a signal (y) 

having media content, comprising: 

a demultiplexing unit (22) arranged to receive a signal Including 
media content (Xq) the amplitude values of which have been 
mapped onto first new values using said first mapping function (Cq) 

35 together with additional embedded Information (O, D), and remove 

the additional Information from the media content. 

28. Signal (y(n)) comprising media content (xQ(n)) with embedded additional 

information (0;D), where the amplitude values of the media content have been 
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mapped onto first new values using a first mapping function (Cq), sucli that the 
additional information can be retrieved from the mapped media content. 
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ABSTRACT 

The invenUon relates to methods, devices, a system of devices and a signal where 
additional Information Is embedded In media content. The system Includes a device (10) 

5 providing additional information (O, D) in a signal (y) having media content, comprising 
a first mapping unit (14) mapping the amplitude values of the media content onto first new 
values, and a multiplexing unit (16) inserting the additional information into the mapped 
media content. The system also includes a device (12) for receiving additional information 
(O, D) In a signal (y) having media content, comprising a demultiplexing unit (22) 

10 arranged to receive a signal Including media content (xq) the amplitude values of which 
have been mapped onto first new values together with additional embedded information 
(O, D), and remove the additional Information from the mapped media content. The 
Invention allows insertion of watermarks Into media content such as audio. 
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